#contrastive learning

UniME introduces a two-stage framework that significantly improves multimodal representation learning by leveraging textual knowledge distillation and hard negative instruction tuning, outperforming existing models on multiple benchmarks.

Meta AI introduces Web-SSL, a family of large-scale visual self-supervised models trained without language supervision. These models achieve competitive results on multimodal benchmarks, challenging the need for language in vision learning.